A Fast Algorithm for Nonnegative Tensor Factorization using Block Coordinate Descent and an Active-set-type method
نویسندگان
چکیده
Nonnegative factorization of tensors plays an important role in the analysis of multi-dimensional data in which each element is inherently nonnegative. It provides a meaningful lower rank approximation, which can further be used for dimensionality reduction, data compression, text mining, or visualization. In this paper, we propose a fast algorithm for nonnegative tensor factorization (NTF) based on the alternating nonnegative least squares framework. To efficiently solve the nonnegativity-constrained least squares problems, we adopted a block principal pivoting algorithm that included additional improvements exploiting the common characteristics of NTF computation. The effectiveness and efficiency of the proposed algorithm are demonstrated through experiments using various real-world and synthetic data sets. We observed that the proposed algorithm significantly outperformed existing ones in computational speed.
منابع مشابه
Fast Nonnegative Matrix Factorization: An Active-Set-Like Method and Comparisons
Nonnegative matrix factorization (NMF) is a dimension reduction method that has been widely used for numerous applications including text mining, computer vision, pattern discovery, and bioinformatics. A mathematical formulation for NMF appears as a non-convex optimization problem, and various types of algorithms have been devised to solve the problem. The alternating nonnegative least squares ...
متن کاملDescent methods for Nonnegative Matrix Factorization
In this paper, we present several descent methods that can be applied to nonnegative matrix factorization and we analyze a recently developped fast block coordinate method called Rank-one Residue Iteration (RRI). We also give a comparison of these different methods and show that the new block coordinate method has better properties in terms of approximation error and complexity. By interpreting...
متن کاملFe b 20 08 Descent methods for Nonnegative Matrix
In this paper, we present several descent methods that can be applied to nonnegative matrix factorization and we analyze a recently developed fast block coordinate method. We also give a comparison of these different methods and show that the new block coordinate method has better properties in terms of approximation error and complexity. By interpreting this method as a rank-one approximation ...
متن کاملA Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion
This paper considers regularized block multi-convex optimization, where the feasible set and objective function are generally non-convex but convex in each block of variables. We review some of its interesting examples and propose a generalized block coordinate descent method. (Using proximal updates, we further allow non-convexity over some blocks.) Under certain conditions, we show that any l...
متن کاملA Block Coordinate Descent Method for Multi-convex Optimization with Applications to Nonnegative Tensor Factorization and Completion
This paper considers block multi-convex optimization, where the feasible set and objective function are generally non-convex but convex in each block of variables. We review some of its interesting examples and propose a generalized block coordinate descent method. Under certain conditions, we show that any limit point satisfies the Nash equilibrium conditions. Furthermore, we establish its glo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010